A Constraint - Based Gestural
نویسنده
چکیده
9 veriied for German by means of electromagnetic articulography. Such a study should then also incorporate medial clusters as well as consonantal nuclei. Also further linguistic dimensions such as word accent etc. deserve closer investigation as to their innuence on timing. Machine learning of parametric time models from a gesturally segmented and annotated corpus should constitute a promising approach in this respect (cf. van Santen 1993). On the other hand the factual realisation of phonological processes must be studied and modelled. Does nal devoicing possess a gradual nature, being moreover conditioned by pragmatic factors (Port & Crawford 1989)? Can Ger-man /8/ realization (Diphthong dift=8] { diphthongieren : : : 8giqKKn]) be conceived of as intrasegmental variation of gestural phasing relationships? What about the syllable-dependent processes of /K/-allophony (frisch fKiM] { Berg b? k] { Bauer bauj ?]), of ich/ach alternation combined with /g/ spirantisation 16 and schwa epenthesis? Can the latter be modelled by short, ge-sturally unspeciied temporal gaps, as hypothesized in Walther (1992)? In conjunction with electromagnetic articulography experiments such hyphotheses can be evaluated very concretely in our approach. The approach presented here addresses the problem of phonology{phonetics coupling by assuming a declarative constraint-based phonology component, which is realized in the constraint logic programming language CUF extended by arithmetic constraints (Walther 1992, 1993). In order to couple this component in a simple fashion and without explicit interfaces to the articulatory synthesizer of Krr oger (1993 a,b), the central concept of gestures is employed. Initial practical results in synthesis demonstrate the general capabilities of our approach. Thus we may view our approach as a useful tool in future research directed towards an empirically anchored demarcation of linguistic phenomena: whether a given instance is best described as categorial-phonological or gradual-phonetic may be evaluated relative to an implemented model which can encompass both. Importantly, the typed attribute-value structure in (7) contains all the information that is needed by the articulatory synthesizer in order to compute the sound event it denotes. 13 In particular, the missing explicit interface documents itself by the absence of e.g. an additional phonetics attribute together with a corresponding complex interpretational relationship between phon and phonetics values. 5 Discussion and summary The nite-state and uniication-based approaches of (Bird 1992) and (Bird & Klein 1993) share the concerns of this work in explicitly advancing the enrichment of HPSG by declaratively speciied phonological information, but lack the quantitative-phonetic orientation pursued here. …
منابع مشابه
Semantic Composition of Multimodal Actions in Constraint-based Grammars
The use of speech-accompanying hand gestures to depict objects, to structure the discourse or to give directions is ubiquitous in face-to-face interaction. In this paper, we analyse multimodal signals consisting of speech and gesture from the perspective of semantic composition in constraint-based grammars: we elevate standard methods from linguistics to description of multimodal input so as to...
متن کاملGestural Alignment Constraints and Unstressed Vowel Devoicing in Andean Spanish
This paper applies the gestural alignment constraint schema proposed by Gafos (2002) to unstressed vowel devoicing in Andean Spanish. I will argue that this approach successfully addresses several characteristics identified in novel data from Cusco, Peru that depart from cross-linguistic trends in vowel devoicing and cannot be readily explained in terms of more traditional Articulatory Phonolog...
متن کاملVerbal Short-term Memory: Cognitive and Neuroscientific Tests of a Perceptual-gestural Account
The store-based and perceptual-gestural accounts of verbal STM suggest that any impairment (e.g. by concurrent oral activity) of articulatory planning/production processes will also impair verbal STM. In contrast, the interference-based Feature Model argues that a concurrent oral activity is only disruptive for STM performance because it introduces irrelevant verbal item features, which interfe...
متن کاملFSM - BASED PRONUNCIATION MODELING USING ARTICULATORY PHONOLOGICAL CODE Draft of July 1 , 2010 at 04 : 23
According to articulatory phonology, the gestural score is an invariant speech representation. Though the timing schemes, i.e., the onsets and offsets, of the gestural activations may vary, the ensemble of these activations tends to remain unchanged, informing the speech content. " Gestural pattern vector " (GPV) has been proposed to encode the instantaneous gestural activations that exist acro...
متن کاملGestural Cohesion for Topic Segmentation
This paper explores the relationship between discourse segmentation and coverbal gesture. Introducing the idea of gestural cohesion, we show that coherent topic segments are characterized by homogeneous gestural forms and that changes in the distribution of gestural features predict segment boundaries. Gestural features are extracted automatically from video, and are combined with lexical featu...
متن کاملA Chance Constraint Approach to Multi Response Optimization Based on a Network Data Envelopment Analysis
In this paper, a novel approach for multi response optimization is presented. In the proposed approach, response variables in treatments combination occur with a certain probability. Moreover, we assume that each treatment has a network style. Because of the probabilistic nature of treatment combination, the proposed approach can compute the efficiency of each treatment under the desirable reli...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007